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(57) Abstract: There is disclosed an integrated programmable system (100) for controlling the operation of a number of electrical 
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An Integrated Programmable System for Controlling 
the Operation of Electrical and/or Electronic Appliances of a Premises 



This invention relates to an integrated programmable system for controlling the operation 
5 of electrical and/or electronic appliances of a premises, e.g. a house, a flat, or an office, and in 
particular such a system allowing the end user to program the mode and manner of operation of 
such appliances as he wishes. 

With the advance of technology, home automation is a goal long sought to be achieved. 
10 Home automation will offer more fireedom and autonomy to the disabled or elderly. Other 
members of the family will also benefit fiom the comfort and convenience offered by home 
automation. 

Existing approaches to home automation are, however, proprietary in nature, and are 
1 5 non-extensible solutions that cannot accommodate the growth of the market. Each company or 
school has its own system and basic structure, which is not compatible with those of other 
companies or schools. In short, the systems and basic protocols are all vendor-specific. 



In addition, existing home electrical appKances and electronic systems suffer firom the 
20 following drawbacks and limitations: 

a. The appliances are mostly self-contained and thus functionally separate firom one another. 

b. All fimctionalities and limitations of the appliances are pre-defined by the manufacturers/ 
vendors. 

c. Very few appliances are "cross-applicational", for example a motion detector connected 
25 to -a standard security control panel cannot usually be used for occupancy energy saving or 

occupancy alarm purpose. 

d. Various appliances may have some common fimctions. For example, an alarm clock 
which rings, a radio clock which tunes to a station at a certain pre-set time, a sprinkler 
control panel which turns on periodically, an occupancy energy saver which turns off 

30 lights after a predetermined period of no activity, and a VCR which records television 

programs all contain an internal clock. At a minimum, this is unnecessary duplication of 
resources. These intemal clocks are also not synchronized with one another, adding to the 
difficulty of having multiple appliances work in concert with one another. 

e. It is very difficult and sometimes impossible to add new functions to appHances which are 
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not originally envisaged by the manufacturers/vendors. 
£ Routing audio aad/or video signals to different locations in the premises cannot be easily 
achieved without installing more wires. Usually, wiring is necessary between any 
possible pair of audio and/or video source and destination, resulting in a large number of 
5 wires for a full-scale installation. 

g. Most appliances have their own respective remote control devices, wliich results in a large 
number of remote control devices being scattered aroxmd the premises, causing confusion 
and inconvenience. 

h. In some situations, co-ordination of several devices is required. For example, for 
10 watching a DVD movie, the television has to be switched to AV mode, DVD video input 

and the appropriate digital audio mode have to be selected for the amplifier, the DVD 
player is then switched on to play the DVD disc, the shades have to be lowered and the 
Hghts to be dimmed. A user thus has to perform all these functions before he can sit down 
to enjoy the DVD movie, and in reverse when he finishes watching the DVD movie, and 
15 wants to watch television again. 

It can thus be fairly said that all the existing electrical and/or electronic appliances operate 
on a stand-alone basis, with very limited, if any, capacity for integration with one another for 
concerted operation. In particular, there is no way for central control and operation of such 
20 appliances. Even if in cases where integration of a number of such appliances of the same 
manufacturer is allowed, such is all pre-designed and pre-^determined by the manufacturer, and 
is thus a closed platform. It is thus not up to the end user to integrate the functions of the 
appliances as he or she wishes, according to his or her own need in view of the physical 
environment. 

25 

Furthermore, in conventional security systems, secxmty zones are set and are usually 
geographically oriented, e.g. one zone per room. Sensor devices in various zones are 
connected to a central security panel. Each particular zone may be individually armed or 
disarmed. Upon triggering of any device, and if the zone is armed, a pre-determined action is 
30 taken, e.g. an alarm is given. There is, however, no assessment of the situation, i.e. each trigger 
of the relevant sensor is considered to be a security event reqriiring action. It is not possible to 
assign a rating on the importance of the alarm signals given by each individual sensor device. 
For example, it is usually difficult to program a control panel to trigger an alarm signal only 
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when a detector and a sensor are both activated within a short term of each other, and even with 
more advanced control panels, more devices and complex relationships are rarely supported. 
False alarms are thus common. 

5 It is also difficult to exclude a particular sequence of activities or a particular device from 

a security profile xmless the device is wired in its own zone, in which case it can be individually 
disarmed. It is thus usually impossible to set the system such that, for example, it ignores the 
sequence of events in which the bedroom door is opened, followed by motion in the stairs and 
motion in the kitchen (which collectively sigmfy someone getting up for a drink), but sounds 
10 alarms in a reversed sequence of eveiits, which collectively signify a burglar breaking in from 
the kitchen and going into the bedroom. The conventional systems thus force the users to 
accept either an indiscriininating all-secured scenario or an all-unsecured scenario. 

It is thus an object of the present invention to provide an integrated programmable system 
15 for controlling the operation of electrical and/or electronic appliances of a premises, e.g. a 
house, an office, a factory, etc., in which the aforesaid shortcomings are mitigated, or at least to 
provide a useftil altemative to the pubUc. 

According to the present invention, there is provided an integrated programmable system 
20 for controlling the operation of a plurality of electrical and/or electronic appliances of a 
premises, wherein said plurality of appliances are controllable electrically, electronically, 
wirelessly, by hafrared and/or by radio frequency, wherein said system includes a central data 
processing apparatus connected with a digital communication backbone, wherein said central 
data processing apparatus is adapted to be connected with said appliances via said digital 
25 communication backbone, characterized in that said system includes sound producing means 
connected to a plurality of sources of audio signals for selectively outputting sound upon 
receipt of audio signals from at least one of said sources or outputting audible alarm prompts 
upon receipt of audio signals from said system. 

30 Embodiments of the present invention will now be described, by way of examples only, 

with reference to the accompanying drawings, in which: 

Fig. 1 is a first schematic diagram of a two-layered distributed network architecture design of 
an integrated programmable system according to the present invention for controlling the 
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operatipn of electrical and/or electronic appliances of a premises; 
Fig. 2 is a second schematic diagram of the system shown in Fig. 1 ; 
Fig. 3 is a third schematic diagram of the system shown in Fig. 1 ; 

Fig. 4 is a schematic diagram showing the physical architectmre of the system shown in Fig. 1; 
5 Fig. 5 is a schematic diagram showing the networking of various electrical aad/or electronic 
appliances in the system shown in Fig. 1; 

Fig. 6 is a schematic diagram showing reproduction of audio signals in the system shown in Fig. 

1; 

Fig. 7 shows a known way of achieving audio distribution; 
10 Fig. 8 is a schematic diagram of m integrated security system forming part of the system 
shown in Fig. 1; 

Fig. 9 is a schematic diagram of an integrated elderly monitoring system fomung part of the 
system shown in Fig. 1; 

Fig. 10 is a schematic diagram of an integrated occupancy energy saving system forming part 
15 of the system shown in Fig. 1; 

Fig. 11 is a schematic diagram of an iutegrated automatic sprinkler system forming part of the 
system -shown in Fig. 1; 

Fig. 12 is a flow chart of the operation of the central server in the system shown in Fig. 1; and 
Fig. 13 is a flow chart of the operation of the smart controller in the system shown in Fig. 1. 

20 

Referring firstly to Fig. 1, such shows, at a first level of understanding, a schematic 
diagram of an integrated programmable system for controlling the operation of electrical 
and/or electronic appliances of a premises, e.g. a house, according to the present invention. 



25 The fundamental design principles are: 

1. The premises is constructed and viewed as a programmable platform, in which every 
aspect of the premises which are served by an electrical and/or electronic appUance are 
controllable via one or more programs written to the platform architecture. 

2. Rerouting or rewiring connections to physical hardware does not require changing of the 
30 system configuration. 

3. To minimize as much as possible hard-wired scenarios. 

4. The system consists of a number of simplistic (dumb) components, each providing only 
one or a few simple generic services, and working in co-operation under the guidance and 
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coordination of a central intelligence. 

5. The components themselves do not preferably have intelligence. 

6. Operations and desired features are implemented by mixing and/or matching of different 
services performed by the individual components. 

5 7. All components are controlled and described by custom-built translators that expose 
standard interfaces to the central inteUigence, so that the central iatelligence does not have 
to be aware of the details of the specific service/hardware providers. 
8. The system is controllable via a number of different user interfaces, e.g. Web browser, 
televisions with remote control apparatus, personal digital assistants (PDA), touch screens, 
1 0 cellular phones, etc. 

As can be seen in Fig. 1 , broadly speaking, an integrated programmable system, generally 
designated as 100, for controlling the operation of electrical and/or electronic appUances of a 
premises consists of a two-layered, distributed network architecture design, with an outer 

15 appUance layer 102 and an inner control layer 104. The appUance layer 102 includes various 
electrical and/or electronic appliances and devices, including, but not limited to, security 
sensors, monitoring devices, audio and/or visual equipment, telephony equipment, Ughting 
apparatus, display devices, control devices, switches, and mechanical devices etc. All such 
appliances are connected to a central home server 106 in the control layer 104, either directly or 

20 indirectly, via a common digital communication backbone. The home server 106 allows the 
end user to control, adjust and program the criteria and maimer of operation of the various 
appliances. The common digital communication backbone includes a central cable (bus) 
which connects all the appUances with the central control layer 104. The common digital 
communication backbone may be a single foil-shielded twisted-pair (FTP) CAT5e cable, 

25 which runs through the whole premises. Also incorporated ia the control layer 104 are a 
number of smart controllers 108 each for directly controlling and monitoring the operation of 
one or more of the various electrical and/or electronic appliances in the apphance layer 102. 
The various smart controllers 108 are connected with the digital communication backbone and 
with one another via one or more network hubs, switches or routers 110, and via which the 

30 system 1 00 may also be connected with the Intemet. 

The smart controllers 108 may be implemented as book-sized form-factor industrial 
personal computers (PQ- Th® actual hardware is PC-based, with a hi^-speed central 
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processing unit (CPU), 256M random-access-memory (TRAM) and a small (say 20-40 GB) hard 
disk drive, and a number of hardware devices implemented in the motherboard itself (e.g. 
lOOBase-T network, analog audio input/output, and 3D graphics). Each smart controller 108 
runs a Microsoft ® Embedded XP operating system. In each smart controller 108 is usually 
5 installed a PCI-based digital input/output (I/O) card with 24 to 84 digital inputs, although the 
system also supports many other brands of PCI-based, cPCI-based, ISA-based or 
RS232/RS485-based digital VO modules on the market. Each digital I/O module card accepts 
switch inputs from a multitude of sensor devices connected to opto-isolated terminals on this 
card with straight electrical wires. Regulated power suppUes provide 12V and 24V DC power, 
10 via electric wires, to these devices and equipment, e.g. motion detectors, smoke detectors, 
glass-break detectors, door and window contacts, gas and water sensors, etc. Contact switches 
are wired in serial with 12V DC supply into each input channel of the digital I/O card so that, 
when a device triggers (e.g. the relay switch closes), electricity at 12 volts will be suppUed to 
the particular I^O channel. 

15 

Various devices and equipment may be comected directly to the smart controller 108 in 
the following manner: 

communicating thermostats (which supports serial protocols) that control the heating, 
ventilating and air conditioning (HVAC) systems are connected to the smart controller's 
20 RS232 serial port, either directly or via a RS485 converter; 

fingerprint scanners are connected to the smart controller 108 via either USB port or 
parallel port; 

infrared receivers and infrared routers/emitters are connected to the RS232 serial ports of 
the smart controller 108; 

25 - some commercial equipment (e.g. plasma TVs and weather stations) also have built-in 
serial communication ports that can be connected to the RS232 serial ports of the smart 
controller 108; 

microphones are connected to the audio input ports, and hardware is available on the 
sound cards to compress these audio streams into digital format (e.g. MPS) for 
30 transmission to other smart controllers or to the home server 106 either for playback or 

recording purposes; 

pan-tilt-zoom video cameras are connected to the RS232 serial ports of the smart 
controller 108 for control, and their video outputs are connected either to the USB ports or 
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to composite video input ports of one or more video capture cards installed in the smart 
controller 108. These video capture cards may contain hardware necessary to compress 
the video streams into digital format (e.g. MPEG2) for transmission, or the compression 
may be performed in software. 

Each comiection to a device or equipment is imique, described by aa address. A central 
database in the home server 106 stores all the addresses of the device or equipment connected 
to the system 100. A device address contains all the necessary information to enable the 
system 1 00 to connect to that particidar device or equipment and to communicate with it. Such 
information may include the serial port number to which the device/equipment is connected, 
commtmications protocol speed, equipment model number, signal timings, data formats, etc. 

Fig. 2 shows the architectural structure of the system 100 at a more detailed level. The 
system 100 includes a Unified Devices Abstraction Layer (UDAL) 112, which corresponds, 
functional-wise, to part of the home ser\^er 106 shown in Fig. 1 and discussed above. The 
hardware equipment may be connected to the UDAL 112 via various standard interfaces. For 
example: 

a. traditional and Intemet telephony apparatus may be connected with the UDAL 112 via 
Telephony AppUcation Programming Interface (TAPI) and Personal Computer-Private 
Branch Exchange (PC-PBX); 

b. audio and/or visual and/or gaming apparatus may be connected with the UDAL 112 via 
DirectX or DirectShow, in which DirectX is a set of application program interface (API) 
developed by Microsoft Inc.; 

c. Ughting apparatus, various electrical and/or electronic apparatus, control apparatus, etc. 
maybe connected with the UDAL 112 via: 

1. ' X-10 electrical power control modules traded by X- 10 Inc., of the US. Suchmodules 

are devices that plug into an electrical outlet and allow a user to remotely control the 
power to a lamp or an appliance that is plugged into them. There are also X-10 
modules that may be installed in place of wall switches to control lights, and some 
can be used to set back a thermostat; 

2. ^ Universal Plug and Play (UPnP), a network architecture that provides compatibility 

among networking equipment, software and peripherals of the various vendors that 
are part of the Universal Plug and Play Forum; 
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3 . GEBus Standard, a iion-proprietary protocol based upon an open standard (EIA 600) 
set down by the CEBns Industry Council, which allows every CEBus HomePnP™ 
device to communicate with every other CEBus HomePnP™ device over the power 
line without the need for new wires. Such CEBus HomePnP™ devices can be 
networked with a central controller for larger and more extensive automation 
projects; 

4. Jini, a software from Sun Microsystems; 

5. remote device management interfaces provided by emWare, Inc. of the US; 

6. Home Audio Video interoperability (EIAVi), a vendor-neutral audio-video standard 
allowing different home entertainment and communication devices (such as VCRs, 
televisions, stereos, security systems, video monitors) to be networked together and 
controlled from a primary device, e,g. a personal computer. Using IEEE 1394 as the 
interconnection medium, HAVi allows products from different vendors to comply 
with one another based on defined connection and communication protocols and APL 
One of the key features of HAVi is its ability to easily add new devices to the network. 
When a new device is installed, the system will configure itself to accommodate it. 
Other services provided by the distributed application system include: addressing 
scheme and message transfer, lookup for discovering resources, posting and 
receiving local or remote events, streaming and controlling isochronoixs data 
streams; 

7. proprietary interfaces; 

8. standard serial bus interfaces, e.g. RS232, 422, 485, USB, and FireWireTM. 
FireWire™ is the name given by Apple Computer Inc. to products supporting the 
IEEE 1394 standard, which is a very fast external bus standard that supports data 
transfer rates of up to 400Mbps; 

9. relays and switches; and 

10. digital and analog input/output interfaces. 

As there are, at least in theory, milimited types of devices or equipment, and different 
ways to communication with or control them, it is necessary for the smart controller system 
software to translate communication protocols and commands for individual devices or 
equipment into a uniform schema for easy adaptation into the system 100. Such program 
logics form the Unified Device Abstraction Layer, and the imiform schema format is the 
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Unified Device Space. 

A possible Unified Device Space format may be a simple device name plus a property 
name, as in the following Table 1: 

5 



Device Name 


Property Name 


Meaning 


TV 


PowerOn 


Status of the power button 


TV 


Chanael 


The current chamiel number 


TV 


Volume 


Audio volxmie 


Air Conditioner 


CurrentTemp 


Current room temperature 


Air Conditioner 


TargetTemp 


Target temperature 


Air Conditioner 


PowerOn 


Status of the power button 


Air Conditioner 


FaaOn 


Status of the fan button 



The system software translates actual device status and setting values into this Unified 
Device Space format. For instance, the TV may be a "legacy device", i.e. one that does not 
have built-in digital communication capabilities. A light sensor may be connected to the 

10 digital I/O board to detect whether the TV power LED is turned on. If so, it will set the 
'TPowerOn" property of the "TV" device to be tme. A physical current sensor may be 
connected to an analog voltage meter to detect the volume level. In order to turn on/off the TV 
or to change chaimel/volume, an infrared emitter device may be called on to emit the relevaat 
infrared remote-control codes. The air conditioner may be controlled by a communicating 

15 thermostat. In this case, finding out the current temperature and power status, etc. can be 
effected by sending the relevant text cormnand via the serial cable connected to the thermostat 
through its RS232 port and waiting for a response, in a format specified by the air conditioner's 
communciations protocol- In the first case, i.e. the case with the "legacy" TV, the system 
software translates a number of physical measurements into logic values represented in the 

20 Unified Device Space. In the second case, the system software translates the air conditioner's 
communications protocol into values in the Unified Device Space. 

The benefit of the Unified Device Space is that, within the present system 100, all other 
system modules can work with a uniform way of controlling, measuring and detecting devices 
25 and their statuses and settings. To a system customization script (see below), the user simply 



wo 2004/077307 

has to issue: 



- 10- 



PCT/CN2003/001075 



SetDevlceProperty ( ^^TV", ^^PowerOn''/ True ) 
SetDeviceProperty ( ^^A/C", ^^PowerOn'', True ) 

5 

to turn on both the TV and air conditioner. The system software automatically translates these 
Unified Device Space commands into the appropriate infrared codes sent by the iafrared 
emitterto the TV, as well as the appropriate text commands sent via RS232 to the thermostat of 
the air conditioner. 

10 

As to the common digital communication backbone, such may be of the Transmission 
Control Protocol (TCP)/Litemet Protocol (IP) or FR/ATM (Frame Relay/Asynchronous 
Transfer Mode) or a virtual private network (VPN), over a cable under 100Base-T (Fast 
Ethemet) standard (IEEE 802,3u), a wireless local area network (LAN), or fibre optics. 

15 

The system 100 may be connected with the Ihtemet via integrated services digital net\vork 
(ISDN) standard, cables, digital subscriber hnes (DSL), etc. The system 100 includes a 
Primary User Interface which allows an end user to interact with the Unified Devices 
Abstraction Layer, including the home server 106 of the system 100, and via DirectSD, which 
20 is an appUcation program interface for manipulating and displaying three-dimensional objects, 
for programming, setting, resetting and/or changing the manner of operation of the various 
components and appUances coimected with the system 100. Some other acronyms appearing 
in Fig. 2 have the following meanings: 

'WAP" stands for Wireless Application Protocol, which is a secure specification that 
25 allows users to access irformation instantly via handheld wireless devices, such as mobile 

phones, pagers, two-way radios. 

"HTML" stands for Hyper Text Markup Language, which is the authoring language used 
for creating documents on the World Wide Web. HTML defines the structure and layout 
ofa Web document by using a variety of tags and attributes. 
30 - "XML" stands for Extensible Markup Language, which is a specification specifically 
designed for Web documents. It allows designers to create their own customized tags, 
enabling the definition, transmission, validation, and interpretation of data between 
applications and between organizations. 
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"ASP" staads for Active Server Pages, which is a specification for a dynamically created 
Web page with a .ASP extension that utilizes ActiveX scripting. When a browser requests 
an ASP page, the Web server generates a page with HTML code and sends it back to the 
browser. 

5 - "ADO" stands for ActiveX Data Objects, which is Microsoft's liigh-level interface for 
data objects. ADO is very general and can be used for accessing all sorts of dijBferent types 
of data, including web pages, spreadsheets, and other types of documents. 
"nS" stands for Intemet Information Service, which is Microsoft's Web server that runs 
on Windows NT platforms. 
10 - **VBScript" stands for Visual Basic Scripting Edition, a scripting language. VBScript is 
based on the Visual Basic programming language, but is much simpler. It enables Web 
authors to include interactive controls, such as buttons and scrollbars, on their Web pages. 

Fig. 3 shows the integration of the hardware protocols, the Unified Devices Abstraction 
15 Layer, also representing the cormnon communication backbone, the system core engine, and 
the control interface. With particular reference to the control interface, it can be seen that the 
system 100 may be controlled by operating over the Intemet, a WAP phone, a computer, a 
remote- control device, a touch screen, or a personal data assistant (PDA) etc.. With the 
advance of technology, some other protocols and/or interfaces may be incorporated into the 
20 existing system. 

Fig. 4 shows a schematic diagram of the system 100 at a yet fiirther different level. The 
system,100 includes a central controller 120, which corresponds to the home server 106 shown 
in Fig. 1. The central controller 120 is coimected with a number of the smart controllers 108, 

25 via a high-speed digital backbone 124, corresponding to the common digital communication 
backbone. Each smart controller 108 is connected with a number of electrical and/or electronic 
appliances, i.e. hardware devices 126, via physical wiring of various types. Most such 
hardware devices 126 are connected to smart controllers 108 that are physically located closest 
to them. Such hardware devices 126 may, however, be comiected directly to the central 

30 controller 120. For the purpose of this invention, a smart controller 108 has processing power, 
its own operating system, application software, a number of virtual devices 128, software 
devices 129, and other converter hardware to communicate with the hardware devices 126 
connected with it 
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A software device is a device that exists only in software and has no necessary hardware 
to match. Such may include speech generators, which exist in software implementation only, 
which take simple text and generate sound signals. These sound signals may then be fed to an 
5 amplifier to produce the sound. 

A 'virtual device is an appliance which pretends to be an actual hardware device, even 
though in reality it only simulates such a device by performing appropriate actions on another 
hardware device. An example of virtual device usage can be found in a PABX system. The 
10 PABX hardware supports a number of central-office phone lines, plus a number of extension 
phones. If virtual devices are designed for such a PABX system, it may include virtual phone 
devices that simulate regular simple phone Unes, even though in reality it calls upon the PABX 
system to perform the duties. The user of such a virtual phone device may not need to know 
that the phone is not a regular phone line, but part of a PABX system. 

15 

The central home server 106 consists of a high-speed PC-based system with a hard disk 
storage of 160GB and RAM of 512MB, connected to the digital communication backbone. It 
runs the Microsoft ® Server 2003 operating system, and is physically coimected to all other 
smart controllers 108 in the same system 100 via a TCP/IP network. Inside the home server 

20 106 is also run the Microsoft ® Data Engine (MSDE), which is a relational database engine 
storing all the device setap information (addresses) for the entire system 100. The home server 
106 is also connected to an XI 0 automation controller, via RS232, ttiat is in tum plugged into 
the electrical mains. The XI 0 automation controller acts as a bridge to control a number of 
devices and equipment which understand the XI 0 power-line carrier protocol. The home 

25 server 106 also contains the Microsoft ® Intemet Information Server (IIS), together with a 
web-application writing in ASP (ActiveX Server Pages) that allows a user to control the system 
via a standard web browser. 

The home server 106 has sufficient hard disk space to store digitized audio files (for 
30 whole-premises audio), digitized video files (for video-on-demand), video and audio 
recordings (e.g. from close circuit TV cameras, telephony answering messages, etc.), and other 
system set-up files in network-shared folders. The smart controllers 108 may request these 
files when they need to play back audio or video in a particular room or house area. The homer 
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server 106 may also act double as a smart controller for a number of rooms and areas in the 
premises. 

The home server 106 automatically runs system software upon start-up that does the 
5 following: 

detects and establishes communications with each smart controller 108 in the network; 
maintains a collection of customization scripts (stored in the database) written in scripting 
languages (VisualBasic, VBScript or JavaScript) that will be triggered upon particular 
system events; 

10 - maintains a snapshots of all the devices and equipment in the system 100, together with 
the current values of all states and settings of each device or equipment These values are 
kept in Unified Device Space format, so that any smart controller or customization script 
may read firom the database without knowing the physical details of tihe device or 
equipment; 

15 - waits until notified by the smart controllers 108 that a particular state or setting of a 
particular device or equipment has changed value; 

when notified of a change, identifies if any customization script should be run due to that 
change, and, if so, executes the script; 

when a script calls for a particular device or equipment to perform a particular action, e.g. 
20 turn the power on, sends a request in Unified Device Space format, to the smart controller 

that is handling that particular device or equipment; 

logs any necessary change notifications in the database for historical reference; and 
keeps an internal clock that wakes up periodically to check whether any scheduled event 
(defined via customization script) should be nm. 

25 

As an example, when an occupant of the premises wants to enter the premises closed by a 
locked door, he/she places his/her finger on a fingerprint scanner connected to a smart 
controller 108. The smart controller 108 will then poll the fingerprint scanner for images 
periodically and detects the new image. It understands that this represents a change of value 
30 for a particular status of the fingerprint scanner, i.e. the previous image was blank. It then 
sends a notification to the home server 106, in Unified Device Space format, notifying it that 
the device 'Tingerprint" has changed the property "Image" to the new image. Upon receipt of 
this notification, the homer server 106 will check through its database and notices that, when 
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the "Image" property has changed for the device "Fingerprint", then the customized script 
"CheckFingerprint" should he run. It then executes the script "CheckFingerprinf which first 
checks the fingerprint with fingerprints stored in the database, to determine a match. If a match 
is found, it sends a request to set the "Open" property of the device "DoorLock" to *true". The 
smart controller 108 handling the door lock, upon receiving this commands, translates the 
command into the appropriate physical action, which is to turn on a digital output channel in 
the Digital I/O board to energize a relay switch that sends 12 volts to the electric door strike, 
opening the door. 

The following is a sample script suitable for controlling the opening or otherwise of the 
firont gate of the premises, upon scaiming of a fibagerprint image by the fingerprint scanner, 
receipt of data firom a smart card, or entry of code via a keypad, as well as other actions of 
various devices and equipment of the system following opening of the firont gate. 



' Check identity of person 

Dim Name As String 

Select Case TriggerSource 
Case "FINGERPRINT" 

' Fingerprint scanned 

Name = IntelliHome.LookupUser(UserlD) 

If Not (Name Is Nothing) Then 

• Track location 

Intel liHome.LocationTrackingC'FRONTYARD") = User ID 

Else 

* Fingerprint not found 

IntelliHome.Devices("FRONTYARD_Speakers\ "TextToSpeech") = "Fingerprint not 
recognized. Access denied." 
Return 
End If 

Case "CARD" 
Case "KEYPAD" 

' Keypad code entry or access card 

Dim CanEnter As Boolean = False 

' Is the key code (or access card) allowed to open the front gate? 

If InteriiHome.CheckSecurity(KeyValue, "OPENFRONTGATE" ) Then 
Dim contact As Integer = Intel liHome.LookupCode(KeyValiie) 
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If contact >= 0 Then 

Name - Intel liHoine,LookupUser( contact) 
IntelliHome.LocationTrackingC'FRONIYARD") = contact 

5 Else 

Name = 
End If 

CanEnter = True 
10 End If 

If Not CanEnter Then 

If Trigger. TriggerProperty = "CAED" Then 

Intel liHome.Devices("FRONTYARD„Speakers", "TextToSpeech" ) = "Invalid 
15 access card. Access denied." 

Else 

IntelliHome.Devices("FRONTYAKD_Speakers", "TextToSpeech") = "Invalid 
entry code. Access denied," 
End If 

20 Return 
End If 

Case Else 
• Return 
25 End Select 

' Disarm perimeter - but retain security of inside 

IntelliHome.Devices("FRONrYARD^Speakers", "TextToSpeech") = "Welcome home, " & Name & 
30 Perimeter is disarmed. Please enter." 

IntelliHome.DisarmSecurityC'FRONTYARD") ' Disarm security in the front yard 

IntelliHome.DisarmSecurity( "GARDEN") ' Disarm security in the back garden 

Int el liHome.DisarmSecurity( "GARAGE") ' Disarm security in the garage 

35 

* Open front gate 

IntelliHome.Devices("FRONTYARD_FrontGate", "Open") = True 
40 ' Turn on lights if after 6 pm or too dark 
Dim LightsOn As Boolean = False 

If Sys tern. DateTime. Now. Hour < 7 Or System.DateTime. Now. Hour > 17 Or 
45 IntelliHome.Devices("LightSensor", "Light") > 0.5 Then 

IntelliHome.Devices("FRONTYARD_FloodLights", "On") = True 
LightsOn = True 
End If 

50 * Turn lights off and close the gate after one minute 



Sys tem.Threading. Thread, Sleep(60000) 
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If Light sQn Then IntelliHome.Devices("FRONTYARD_FloodLights" , "On") = False 
' Close front gate 

5 

IntelliHome.DevicesC'FRONTYAED^FrontGate", "Open") = True 

Fig. 5 shows a schematic diagram of the system 100 at a still further different level. As 
can be seen, various electrical aad/or electric components and devices are connected via a 
10 central digital common communication backbone with the home server 106, via various 
standard interfaces, e.g. HAVi, digital/analog and input/output modules, X-10, telephone Unes, 
and serial bus, e.g. 232 (RS232) interfaces. 

Fig. 6 shows a schematic diagram of a digital distributed audio module, forming part of 
15 the system 100. The central controller 120, which corresponds to the home server 106 shown 
in Fig. 1, contains an archive of pre-recorded audio files in compressed digital formats, e.g. 
MP3, WMA, RA, SND, PCM, WAV, MIDI, etc. The central controller 120 is connected to 
each smart controller 108 via the digital network backbone 124. Each smart controller 108, 
among other features, is connected to sound generating hardware for producing audio 
20 recording from the digital stream. In particular, the smart controller 108 is connected to one or 
more speakers 130 via an ampUfier 132. To enhance the flexibility and/or the audio quaUty, a 
local Hi-Fi system 134 may be connected to the speaker 130 via a relay switch 136. The 
system is so designed that audio signals from the smart controller 108 will always take 
precedence over those from the local Hi-Fi system 134, in particular because some audio 
25 prompts from the smart controller 1 08, e.g. alarms, must be heard. 

The speakers are connected to an amplifier, which is in turn connected to the digital audio 
output port of the smart controller 108. Audio signals produced by the smart controllers 108 
(e.g. music, or system alert messages) is amplified and outputted via the speakers. If the smart 

30 controller 108 controls more than one set of speakers, then separate digital sound cards are 
installed in the smart controllers 108, each sound card being connected to a separate amplifier 
connected to each set of speakers. There may be a separate local high-end Hi-Fi system in 
some rooms, e.g. the entertainment room. In this case, both the speaker line outputs from the 
amplifier connected to the smart controller 108 and the speaker line outputs from the local 

35 Hi-Fi system are connected to the inputs of a relay switch (the local system to the 
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normally-closed input, and the smart controUer 108 to the normally-open input), with the 
output of the relay switch connected to the actual speakers. The relay switch is activated by an 
audio signal sensor, which is connected to the analog audio output of the smart controller 108. 

5 By way of such an arrangement, when no audio signal is played by the smart controller 

108, the relay switch will stay in the normally-closed position, which connects the local Hi-Fi 
system to the speakers. Upon audio signals generated by the smart controller 108, the audio 
signal sensor will energize the relay switch, which will then switch to the normally-open 
position, disconnecting the local Hi-Fi system and coimecting the smart controller amplifier 

10 with the speakers. Thus, any audio output fi^om the smart controller 108 will override audio 
output firom the local system. This is crucial as certain system-generated audio output (e.g. 
alert messages, warning messages) must be heard and should thus override any other audio 
streams currently playmg. When the smart controller 108 stops outputting audio signals, the 
audio signal sensor will de-energize, and the relay switch will return to the normally-closed 

1 5 position, thus disconnecting the smart controller 1 08 and re-coimecting the local Hi-Fi system 
with the speakers. 

The benefits of such an arrangement include: 

the number of physical wires is reduced, in particular as a digital coramxmication 
20 ba!ckbone is used for carrying ahnost all types of programs and audio signals; 

such enables the use of the same set of hardware for all audio generation purposes; 
pre-recorded audio pieces are shared among all zones; 

dififerent audio pieces may be played in each different zone, at its own respective pace; 
the same audio piece may be played in different zones, which are geographically remote 
25 from each other; and 

local Hi-Fi systems are seamlessly integrated into this arrangement. 

In contrast. Fig. 7 shows a schematic diagram of a known way of achieving audio 
distribution module, which is both costly and less flexible. Source devices, e.g. DVD players 
30 140, CD changers 144, radio tuners 142, MD decks, etc. are located at a central location. 
Audio signals firom the source devices are fed into a matrix switch 146, either amplified or 
pre-amphfied. The matrix switch 146 is mapped to a number of zones, each representing a 
room or a particular designation of audio signals. Speaker wires extend out of the matrix 
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switch 146, one set for each zone, directly to the speaker(s) 148 in the particular zone. The 
matrix switch 146 is controlled hy various control devices, e.g. remote controls, wall panels, 
etc.. At any one time, a particular program source is connected (switched) to a particular zone, 
enabling the speaker(s) 148 in the zone to receive the output of the program source. Separate 
5 routing technologies have to be used for controUing separate program source devices, e.g. 
infrared remote devices use infrared radiation to transmit remote control signals to one of the 
source devices, and radio frequency remote control apparatus may control a device via radio 
frequency signals. 

10 Fig, 8 shows a schematic diagram of aprogrammable security feature, forming part of the 

system 100. hi this security system, a motion detector 150 for detecting motion is connected 
via the common digital communication backbone with the central server 120 of the integrated 
programmable system, which is in turn connected with (a) a speaker, which may be the speaker 
130 of the digital distributed audio module shown in Fig. 6, for producing pre-recorded audio 

15 message; (b) lights 152, (c) a telephone 154 directly for dialing a pre-determined telephone 
number, and/or (d) a telephone 156 via a speech generator 158 for producing synthesized audio 
message and transmitting same through the telephone 156. 

Byway of such an arrangement, the security feature may be constructed of components of 
20 other existing systems, e.g. a motion detector of a security system, a speaker of an audio-visual 
system, existing Hghting system, and a telephone of a telephony system, etc. 

Fig. 9 shows an integrated elderly momtoring feature, fonrdng part of the system shown in 
Fig. 1. In this elderlymonitoring feature, a clock 160, a motion detector 162, and a microphone 
25 164 are connected, via the common communication backbone, to the central server 120 of the 
system 100. The central server 120 contains a programmable logic 166 which has been pre-set 
such that, if neither motion nor sound is detected for a pre-determined period of time (as 
counted by the clock 160), alarming signals will be outputted by speakers 168 which may, 
again, be the speaker 130 of the digital distributed audio module shown in Fig. 6. 



30 



Fig. 10 shows an integrated occupancy energy saving feature, formiag part of the system 
shown in Fig. 1, consisting of a clock 170 and a motion detector 172 connected, via the 
common communication backbone to the central server 120 of the system 100. The central 
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server 120 contains a logic 174 which has beenpre-set such that, if neither motion nor sound is 
detected for a pre-determined period of time (as counted by fhe clock 170), lights 176 also 
connected with the system will be switched off, so as to save energy consumption. It should be 
understood that the clock 170 in this occupancy energy saving system may be the same as the 
5 clock 160 in the integrated elderly monitoring feature discussed above. 

Fig. 11 shows an integrated automatic sprinkler system, forming part of the system shown 
in Fig. .1. The sprinkler system includes a clock 180 and an electronic weather station 182 
connected, via the common conmiunication backbone to the central server 120 of the system 
10 100. The central server 120 contains a logic 184 which has been pre-set such that, if no rain 
falls when a pre-determined time (as counted by the clock 180) is reached, a sprinkler 1 86 also 
connected to the system will be activated. 

Fig. 12 is a flow chart showing the operation of the central server 120 discussed above. 

15 When the system 100 is activated, it is first initiaUzed (step 302). The device database 304 is 
loaded (step 306), followed by loading of triggers and scripts (step 308). The smart controllers 
108 are then comiected (step 310). The system 100 will then check if there has been any 
change in or to the UDAL (step 3 12). If so, the device database 304 will be updated (step 3 14), 
and if the history is to be stored (step 316), the archive will be written (step 3 1 8). The system 

20 100 will then check if trigger has been fired (step 320). If yes, it will spawn script (step 322), 
but if not, it will check other modules (step 324), and if a positive result is detected, the specific 
module action will be carried out (step 326), e.g. by sending appropriate control commands. If, 
on the olher hand, there is no change in or to the UDAL, the system will check for control 
command (step 328). If the result is positive, UDAL value change will be sent to the smart 

25 controllers 108 (step 330). If not, a clock in the system will check if it is time for some 
scheduled events (step 332). If yes, it will spawn the appropriate script (step 322), but if not, 
the system 100 will resxmie checking if there has been any change in or to the UDAL (step 
312). 

30 As to Fig. 13, such is a flow chart showing the operation of tilie smart controller 108 

discussed above. When the system 100 is activated, the system will be initialized (step 402), 
and local and device UDAL maps will be loaded (step 404) firom the database 406. The device 
settings will also be loaded (step 408) from the database 406. The smart controller 108 is then 
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connected to the system 100 (step 410). The controllers 108 then scan through the central 
database and identify all devices and equipment connected to each respective controller 108 
and gets their addresses. All comiected devices are also initialized (step 412). Each 
device/equipment is initialized with the information provided by its respective address. This is 
5 done via a separate piece of program logic specifically developed for each type^rand/model of 
device or equipment. Some devices or equipment, e.g. sound cards for audio generation, are 
installed inside the smart controller 108, These devices/equipment are controlled in the same 
manner as devices/equipment external to the smart controller 108, although in the case of 
devices/equipment installed inside the smart controller 108, communication is usually much 
10 more reliable and instantaneous, since they do not have to send signals to the smart controller 
108 vjflf physical wires. All device states are then updated (step 414). Translators exist to call 
specific control protocols to get the status of their states (step 416). 

The smart controller 108 will maintain communication with the devices/equipment. The 
15 equipment may send a notification message automatically when a state or a setting has changed, 
e.g. the state of a thermostat will change when there is a change in the temperature. The 
equipment, e.g. digital I/O modules, may on the other hand require periodic polling to discover 
its current status and settings, which are then compared with the system's internal copy of the 
states and settings in order to discover whether any of them has changed. 

20 

The system 100 will then continuously check if there has been any change in the state of 
the various devices and equipment (step 418). If there has been any change in a state or setting 
of a device/equipment, the smart controller 108 to which the device/equipment is connected 
will send information to the home server 106, such that other programs or other smart 

25 controllers may act on this information. The device state will be mapped to the UDAL value 
(step 420), and the UDAL value will then be updated in the server (step 422). After this 
updating (step 422), or if there has not been any change in the state, the system will then check 
if there has been any UDAL change (step 424). If there has been any UDAL change, the 
UDAL value will be mapped to the device state (step 426), and the device state set accordingly 

30 (step 428). The translators will then convert the state change to specific control protocol (step 
430) for operation of the appliances or devices coimected with the smart controllers 108. Ih 
particular, the translators can translate proprietary means of controlling individual devices into 
standard interfaces, thereby to allow the system 100 to control and acconmiodate with 
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electrical and/or electronic devices in a xinifonn manner. When instructed by the system 100, 
the smart controller 108 will act upon such request to control or initiate actions on the 
device/equipment. The particular means to accomplish such actions depend on the brand and 
model of the equipment, and the communication protocol used by that piece of equipment. The 
5 smart controller 108 also puts up a user interface from the graphics chip, with its output 
connected directly to a visual output, e.g. a TV set, to enable the user to control the system 1 00 
using the TV. 

With the present invention, it is possible to construct and implement a threat-based 
10 security system. In such a system, "event" is defined as change in the state of an input service, 
e.g. a sensor; "group" is defined as a collection of similar events which are regarded as forming 
a coherent set, e.g. in a security zone; **threat" is determined by reference to the amount and 
nature of security danger represented by an event, given the sequence and threat levels of 
previous events; and "action" is the activity to be carried out when a particular type of threat 
15 has exceeded a predetermined threshold level, which may be govemed by the sequence and 
nature of previous detected events. 

In such a system, events are detected when a particular state of an input service/sensor has 
changed, e.g. a window sensor changes firom being closed to being open. The event so detected 
20 is that mapped to a set of groups that contain that particular type of event, e.g. window being 
opened. Each mapped group has an intrinsic priority level, and the group Ust is then sorted 
according to the priority levels, allowing more general groups to be overridden by more 
specific groups, e.g. allowing all window openings to be monitored except a particular window. 

25 The group of the highest priority is then mapped to a set of threats that would trigger when 

the group is activated. Each threat will generate a corresponding threat level number and a 
threat type, depending on the particular event and the sequence of previous events, if any. For 
example, a window being opened may be particularly suspicious if followed by motion 
detected by a motion detector close to the window. However, the suspicion level will be less if 

30 opening of the window follows motion inside the house, which may indicate someone in the 
house opening the window for firesh air. 



The highest threat level is taken as the tirreat level of this particular event, since the event 
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may mean different levels of threat for different areas/sitaations, and only the highest threat 
level is considered. The system will monitor the current threat level, and the threat level of the 
current event will be added to the current threat level, under which the degree of threat to the 
premises is continuously monitored and assessed. If, at any time, the resultant current threat 
5 level exceeds a pre-determined level, then one or more pre-determined actions will be taken, 
e.g. an alarm is triggered and/or lights in the garden are turned on. The current threat level will 
be reduced by a predetermined percentage after the passing of a pre-set period of time between 
the events, such that events happening between a long period of time are considered to pose 
less threat than events happening betw^een very short period of time, say, one happening 
1 0 immediately after the other. 

A§ an example, the following Table 1 gives the hypothetical threat level assigned to a list 
of exemplary events detected by sensors of the security system: 

15 Table 1 



Detected Events 


Threat Level 


Motion in the garden 


1 


Kitchen wiadow opened 


2 


Kitchen window opened within five (5) 
miautes of motion ia the garden 


3 


Motion in the kitchen 


2 


Motion in the kitchen within two (2) minutes 
of kitchen window opened 


4 


Motion in the master bedroom 


2 


Motion in the study where a safe is kept 


4 



Let us assume that the system is set such that: 

a. an' alarm will be sounded if at any one poiat, the current threat level reaches at least 10; 

b. the current threat level will automatically fall by 1 0% with the passing of every 5 minutes 
20 in which no new event is detected by the system. 

In this example, if motion is detected ia the garden, the threat level will be 1 . If no event is 
detected for five minutes, the threat level will fall to 0.9, and subsequently to 0.8 1 if no event is 



wo 2004/077307 PCT/CN2003/001075 

-23- 

detected for another jSve minutes. Assume that within 2 minutes of motion in the garden, the 
kitchen window is detected as opened, the threat level will be 4 (i.e. 1+3). If, then, within 30 
seconds of opening of the kitchen window, motion is detected in the kitchen, the threat level 
will rise to 8 (i.e. 4+4). If, within, five minutes, motion is detected either the master bedroom 
or the study where a safe is kept, the threat level will rise to 10 or 12. In either case, an alarm 
will be.soimded. If, however, motion is detected in the master bedroom after, say, 6 minutes, 
the threat level will only be 9.2 (i.e. 8 x 90% + 2), thus not enough to set off the alarm. If, on 
the other hand, motion is instead detected in the study where a safe is kept after, say, 10 minutes, 
the threat level will be 10.48 (i.e. 8 x 90% x 90% +4), in which case the alarm will still be set 
off 

Take another example, if the sequence of events is different, say motion in the study where 
the safe is kept, followed within five minutes by motion in the kitchen, then followed within 
five minutes by opening of the kitchen, then followed within five minutes by motion in the 
15 garden, the threat level will only be 9, which is not enough to set off the alarm. 

The advantages and characteristics of such a threat-based security systems include: 
a. instead of focusing solely on the triggering of the individual devices/sensors, the actual 
events, which, are of more concem to occupants of the premises, are also focused upon; 
20 b. an event is made up of a number of device triggering in a particular predetermined order; 

c. both the triggering of the devices and the sequence order of such triggering are taken into 
account; and 

d. the threat levels are continuously monitored and assessed, depending on whether certain 
events have been recorded, and if so, when that event was recorded. 

25 

With such an arrangement, each individual event may be categorized in a more intelligent 
manner, based on the actual degree of threat that it poses. It is, of course, the case that some 
events are more significant that others. False alarms will be reduced. Security breach events 
can be distinguished fi-om mere warnings, thus focusing security attention to the actually 
30 important incidents. Different response actions can be triggered, depending on the degree of 
threat, thus ensuring that appropriate actions be taken in response to the relevant incidents. 

with the above arrangement of an integrated programmable system according to the 
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present invention, the following functions can be achieved: 

a. identity recognition; 

b. personalized settings for temperature, lighting, music, audio and/or visual equipment; 

c. baby and elderly monitoring; 

5 d. notification of significant events, e.g. by audio signals; 

e. hazard detection and warning; 

f. flexible control and monitoring of the system via touch pads, infrared remote control 
apparatus, mobile phones, computers or through the hitemet; 

g. integration with popular existing electrical and/or electronic appliance interfaces, e.g. 
10 XIO, emWare, UPnP/Home API, Jini, HAVi, etc.; 

h. complete control over Ughting of the entire premises, including preset scene lighting, and 
remote control of Ughts in another room or area; 

i. automatic, scheduled or on-demand recording of video and television shows; 

j . a common timing apparatus for (1) keeping calendar and schedules for home members; (2) 
15 reminders and event tracking; (3) automatic timed/scheduled events based on 

environmental situations, e.g. sprinklers on only when not raining; (4) playing pre-set 
messages or execute pre-determined actions at pre-determined time; (5) intelligent alarm 
clocks, e.g. also turning on the radio to a pre-set station for reporting the weather and 
traffic condition; 

20 k. video surveillance and security monitoring of all windows and doors, with motion/smoke 
detectors activated; 

1. intelligent actions upon penetration of security boundary, security triggers or fire threat, 
e.g. sounding alarms, notifying occupants via telephone or the Litemet, or reporting to the 
police or fire station; 

25 m. creating non-repetitive at-home scenes automatically for discouraging break-ins; 

n. allowing, after identification via remote video, entry of visitors, workmen or deliverymen, 

and full video monitoring of their activities in the premises; 
o. announcement of identity of telephone caller; 

p. tailored greetings and message boxes for identified telephone callers; 
30 q. specific barring or diversion of particular telephone caller(s); 
r. message box for individual and event play back; 

s. telephony system being accessed via WAP or normal phone for remote control, message 
centre access and status monitoring; 
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t plug-in Memet and World Wide Web access throughout the entire premises; 
u. remote control, video surveillance and status monitoring via the Intemet; and 
V. intra-premises e-mail services. 

5 It can be seen that various existing and future electrical and/or electronic appliances may 

be integrated into this system because of the use of existing standard interfaces. It is also up to 
the end user to incorporate new appliances into the system according to his or her own need, 
taking into account the physical enviromnent of the premises. Since the system can be 
coimected with such appliances via different existing standard interfaces, a large variety of 
10 such appliances can be integrated, thus greatly enhancing the ability of the system to 
accommodate different sorts of appliances of different manufacturers. Simply stated, a system 
according to the present invention is an open platform with virtually unlimited possibility of 
extension and modification. 

15 It should be imderstood that the above only illustrates examples whereby the present 

invention may be carried out, and that various modifications and/or alterations may be made 
thereto without departing fi-om the spirit of the invention. Although the above examples are 
illustrated with home-oriented examples, it should of course be understood that the invention is 
equally applicable to other premises, e.g. offices, factories, hospitals, etc. 

20 

It should also be understood that certain features of the invention, which are, for clarity, 
described in the context of separate embodiments, may be provided in combination in a single 
embodiment. Conversely, various features of the invention which are, for brevity, described in 
the context of a single embodiment, may also be provided separately or in any appropriate 
25 sub-combinations. 
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CLAMS:- 

1. An integrated programmable system for controlling the operation of a plurality of 
electrical and/or electronic appliances of a premises, wherein said plurality of appliances 
are controllable electrically, electronically, wirelessly, by infrared and/or by radio 

5 frequency, wherein said system includes a central data processing apparatus comiected 

with a digital communication backbone, wherein said central data processing apparatus is 
adapted to be connected with said appliances via said digital communication backbone. 

2. A system according to Claim 1 fiirther characterized in that said system includes souaid 
producing means connected to a plurality of sources of audio signals for selectively 

10 outputting sound upon receipt of audio signals from at least one of said sources or 

outputting audible alarm prompts upon receipt of audio signals from said system. 

3. A system according to Claim 2 fiirther characterized in ttiat audio signals from said 
system are prioritized above audio signals from said sources of audio signals. 

4. A system according to Claim 1 fiirther characterized in that said data processing apparatus 
15 comprises a computer server. 

5. A system according to Claim 1 fixrther characterized in that said communication backbone 
includes at least a network hub, switch or router. 

6. A system according to Claim 1 fiirther characterized in including at least one controller 
for controlling the operation of said plurality of electrical and/or electronic appliances in a 

20 predetermined manner. 

7. A system according to Claim 6 fiirther characterized in including a plurality of said 
controllers which are spaced apart from one another. 

8. A system according to Claim 1 fiirther characterized in being adapted to be connected 
with said electrical and/or electronic appliances via at least two different standard 

25 interfaces. 

9. A 'system according to Claim 1 fiirther characterized in that said system is adapted to 
connect at least two said appliances together by Home Audio Video interoperability 
(HAVi) standard. 

10. A system according to Claim 1 fiirther characterized in being adapted to be connected 
30 with at least one said appliance via Universal Plug and Play (UPnP) architecture. 

11. A. system according to Claim 1 fiirther characterized in incorporating a unified devices 
abstraction layer with at least one translator for translating proprietary means of 
controlling individual devices into standard interfaces, and thereby to allow said system to 
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control devices in a uniform manner. 

12. A system according to Claim 1 further characterized in that said system is adapted to be 
connected with at least one said appliance via a standard serial bus interface. 

13. A. system according to Claim 1 further characterized that said system is adapted to be 

connected with at least a lighting device via at least one electrical power control module. 

14. A system according to Claim 2 further characterized in that said sound producing member 
comprises a speaker. 

15. A system according to Claim 2 further characterized in that said plurality of audio signal 
sources include said central data processmg apparatus, an audio system, an audio-visual 
system, and a microphone. 

16. A system according to Claim 1 further characterized in being adapted to be connected 
with a security system. 

17. A system according to Claim 16 further characterized in that said system is adapted to be 
connected with and to coimect a plurality of components of said security system via said 
common commnnication backbone. 

18. A system according to Claim 1 6 further characterized in that said security system includes 
at least a motion detector. 

19. A system according to Claim 1 6 further characterized in that said security system includes 
at least a speaker, 

20. A system according to Claim 1 6 furttier characterized in that said security system includes 
means for dialing at least one pre-determined telephone number. 



wo 2004/077307 



PCT/CN2003/001075 




wo 2004/077307 



PCT/CN2003/001075 



2/12 




MSDE - Microsoft 
Data Enaiiie 




Settings, Devices Database, 
Historical Data Archives etc. 

Security Sensors & 
Other Detectors etc. 

Mechanical Devices 
Monitoring & Control 

Equipment Controllable via 
Serial Buses (e.g. RS232) 

Weather Monitors, 
Thermostats etc. 





emWare 


HAVi 


CE Bus 


Jini 


XIO 


UPnP& 
HomeAPI 













DO 

B 



a. o 



Windows Media 
Technologies 



DirectX & 
DirectShow 



Speech Synthesis & 
Speech Recognition 

Audio / Video 
Streaming & Conf. 

Audio / Video / Games 

Traditional & Internet 
Telephony 




wo 2004/077307 



PCT/CN2003/001075 



3/12 




Sony Home 
Sun I OSG 
Microsoft 

GEI 
erriWare 

CEBus 
XlOInc. 



Future... 



Future... 



wo 2004/077307 



PCT/CN2003/001075 



4/12 




o 
OJ 











S 




C CI 


f; 




a> CD 






QCO 










/ 







CO 
o 



CO 

CD 













MS? 





-2 

b 

CD 

CD 

Q- 

CO 
I 

x: 



wo 2004/077307 



PCT/CN2003/001075 



5/12 




wo 2004/077307 



PCT/CN2003/001075 





wo 2004/077307 



PCT/CN2003/001075 



7/12 




wo 2004/077307 



PCT/CN2003/001075 



8/12 




wo 2004/077307 



PCT/CN2003/001075 



9/12 




CD 

CD 

•*-> 
C 

CD 

o 




i ^ 

o o 
to o 



E Q) CL o o 




c 
o 

CO 

o 













is 





















as 



SO 



wo 2004/077307 



PCT/CN2003/001075 



10/12 




wo 2004/077307 



PCT/CN2003/001075 



11/12 




wo 2004/077307 



PCT/CN2003/001075 



12/12 



tcJ g o 
S o > 



o 



II 



o 



S 




-< 8 S 

> ■a 



j3 S 

T o c'^ •ir' 

O O 4-; 

IS .y 



2 S^fi 





OJ 
OJ 



^ o 



V ij = 



5' 



0 



E o 

CO O 



o 

Li. 




OJ 



^^1 



00 

cu 



> OJ 



o 
CO 




CO 



INTERNATIONAL SEARCH REPORT 



International application No. 

PCT/CN03/01075 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 G06F 15/16 
According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 G06F 15/00 G06F 15/173 G06F 15/16 F25D 29/00 H04Q9/00 G08B 25/10 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 

Database: WPI EPODOC PATENTPIC PAJ CNPAT 
Keywords: network internet control remote interface audio video process appliance home house fiat sound alarm connect communication 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 
X 

Y 

A 
Y 



Citation of document, with indication, where appropriate, of the relevant passages 

CN1375674A, LG ELECTRONICS ESTC, 23.0ct. 2002 (23.10.2002), 

description page 3 lines 23 to page 5 lines 8, fig. 1 



US2002/0 103898A1 Moyer et aL 01 .Aug. 2002( 01 .08.2002), 

paragraph 0101, 0347-0348 and fig. 7 ,11 and 12 

CN1241762A,ZHAO Z,19.Jan.2000(19.01.2000), description page 4 lines 36 to page 5 lines 36 



Relevant to claim No. 

1,4-10,12 

2,3,13-20 
11 

2,3,13-15 
16-20 



I Further documents are listed in the continuation of Box C. ^ See patent family annex. 



* Special categories of cited documents: 

"A" document defining the general state of the art which is not 

considered to be of particular relevance 

"E" earlier application or patent but published on or after the 
international filing date 

"L" document which may throw doubts on priority claim (S) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 

other means 

"P" document published prior to the international filing date 
but lat^ than tiie priority date claimed 



"T" later document published after the international filing date 
or priority'' date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X** document of particular relevance; the claimed invention 
caimot be considered novel or cannot be considered to involve 
an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 
cannot be considered to involve an inventive step when the 
document is combined with one or more other such 
documents, such combination being obvious to a person 
skilled in the art 

" & " document member of the same patent family 



Date of the actual completion of the international search 
15.Mar. 2004 (15.03.2004) 



Date of mailing of the international search report 

2 5 -1^1^2004 (2 5 • 0 3-2 0 0 4) 



Name and mailing address of the ISA/CN: 

6 Xitucheng Rd., Jimen Bridge, Haidian District, 
100088 Beijing, China 

Facsimile No. 86-1 0-6201 945 1 



Authorized ofiicer 



Telephone No. 86-10-62085041 




Form PCT/ISA /210 (second sheet) (January 2004) 



INTERNATIONAL SEARCH REPORT 



International application No. 

PCT/CN03/01075 



C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


A 


WO00/46965A2 10.Aug. 2000(10.08.2000) SIEMENS AG the whole document 


1-20 



Form PCT/ISA/210 (continuation of second sheet ) (January 2004) 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 


International application No. 

PCT/CN03/01075 


Dociimenf" members 


Faraily tnembers 


_ 


CN1375674A 23. 1 0.2002 


US200 1 0 1 05 1 6 Al 






DE10100826A1 


09 08 9001 




JP2001248955A 


14.09.2001 




KR2001077304A 


17.08.2001 




KR2001077305 A 


17 08 7001 




KR2001077306A 


17.08.2001 




US6393848 B2 


28.05.2002 


, US2002103898A1 01.08.2002 


WO02061589A 


08.08.2002 




US2003072074A 


17.04.2003 



JP2003 1 15799A 18.04.2003 



WO0046965A 



10.08.2000 



DE19904544A 

AU3416300A 

DE19950576A 

EP1106005A 

EP20000912354 

CN1310906T 

JP2002536914T 



17.08.2000 
25.08.2000 
10.05.2001 
13.06.2001 
03.02.2000 
29.08.2001 
29.10.2002 



Form PCT/IS A /2 1 0 (patent femily annex) (January 2004) 



